Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flink improvements rocksdb state pr #406

Merged

Conversation

wagmarcel
Copy link
Member

No description provided.

@wagmarcel wagmarcel force-pushed the flink-improvements-rocksdb-state-PR branch 3 times, most recently from 169cded to 8bc978f Compare July 19, 2023 21:53
@wagmarcel wagmarcel force-pushed the flink-improvements-rocksdb-state-PR branch from 8bc978f to 91e6f7f Compare July 26, 2023 08:25
@wagmarcel wagmarcel marked this pull request as ready for review July 26, 2023 08:56
…nfigs when there where access right problems earlier

Signed-off-by: marcel <[email protected]>
…y and RocksDB based state backend

Signed-off-by: marcel <[email protected]>
Statements do not only contain SQL INSERTs, TABLES and VIEWS, they can also contain
SETTINGS, like ttl, pipeline.name, etc. In order to make it more applicable to
the Operator and SQL-Gateway, the sqlsettings must be provided as list of key/value pairs.

Signed-off-by: marcel <[email protected]>
…ovee kafkatopics before deploying flink

Strimzi is great. But one annoying behaviour is that it creates KafkaTopic CR for every topic it finds
on Kafka. This is in principle great, because KafkaTopic CRDs allow configuring all details of topics, like
replication. However, when an application creates a Kafka Topic, Strimzi creates a KafkaTopic CR which conflicts
with the CRs from the helm deployments. In order to be able to delete the KafkaTopics CR which are relevant, the
KafkaTopic CRs are created in separate files to be able to explicitly delete them before deploying the shacl job.

Closes IndustryFusion#402

Signed-off-by: marcel <[email protected]>
@wagmarcel wagmarcel force-pushed the flink-improvements-rocksdb-state-PR branch from 91e6f7f to b2c3bb4 Compare July 26, 2023 11:47
@wagmarcel wagmarcel merged commit af09205 into IndustryFusion:main Jul 26, 2023
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants